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Abstract 


Many time series are based on data obtained from sample surveys. Changes to the data source 
or methodology of a survey can have an impact on the original survey estimates and the 
seasonally adjusted and trend estimates derived from them. To assess the impacts of the 
changes to the survey, data can be collected from the old and the new survey for one or more 
overlapping time periods. This produces parallel series of original estimates. The number of 
overlapping time periods is typically small due to cost constraints. It is desirable to assist 
users by calculating seasonally adjusted and trend estimates for the new survey. Traditional 
seasonal adjustment methods cannot adequately calculate seasonally adjusted and trend 
estimates for short time series. Theory for estimating seasonal factors for short spans of time 
series data is given and illustrated with an example. 


Keywords: short time series, multi-level modelling, seasonal factors, mixed effects 


1 Introduction 


The Australian Bureau of Statistics (ABS) is continually improving the sources and methods 
used in its surveys. This can occur by: changes in the sampling frames, scope and coverage of 
a survey, improved estimation techniques, new ways of collecting information or ultilising 
other sources of data such as administrative by product data. Methodological changes to the 
source or methods of a survey will impact on the original survey estimates and the associated 
seasonally adjusted and trend estimates. When such changes are substantial, for example the 
scope of the survey expands significantly, comparability of the data over time can be 
compromised. 


Methodological changes to a survey can lead to the survey being replaced with a new survey 
that uses a vastly different survey design. It is desirable to assist users by calculating 
seasonally adjusted estimates for the new survey. Traditional seasonal adjustment methods 
cannot adequately calculate such estimates for short time series. This means there could be 
several years before reliable seasonally adjusted estimates are produced from the new survey. 


This paper describes a method for estimating seasonal factors for short spans of time series 
data. The method uses a multi-level model with mixed effects. This method has been used to 
estimate and test for differences in the seasonal factors for the survey. We apply the method 
to estimate seasonal factors for the private sector gross earnings estimates obtained from the 
Quarterly Business Indicator Survey (ABS, 2001a), which is the replacement for the Survey 
of Employment and Earnings (ABS, 2001b), using four parallel quarter estimates in 2001. 
The results have been used in the compilation of the ABS National Accounts for March 
quarter 2002. The method described in this paper could also be applied to time series 
generated using an alternative approach to a survey, e.g. the use of administrative data 
sources. 


2 Modelling framework 


2.1 Old and new surveys 


Consider the case where a new survey has started that will replace an existing survey, now 
refered to as the old survey. A realistic assumption may be that the new survey measures the 
same underlying activity as the old survey although the coverage and scope may be different. 
This means that the underlying movements are the same but the time series may shift to a 
different level. The ABS use the trend component (ABS, 1987) to represent the long term 
movement in a time series. When methodological changes occur, the trend level for the new 
survey may be different from the old survey, while the movement of the trend could be the 
same between the old and new survey. The seasonal factors could be different for the old and 
new surveys because of the different scope and coverage and other methodological changes 
that have occurred. For example, the new survey might have better coverage of small 
businesses and improved classification or identification of large businesses. This will mean 
the seasonality of the two surveys may be different, even though the same underlying activity 
is still being measured. 


To help assess the impact of the changes, original estimates can be calculated using data 
collected from the old and the new survey for one or more overlapping time periods. The 
number of overlapping time periods is typically short due to cost constraints of conducting 
two surveys simultaneously. 


Our objective is to test whether the seasonal patterns are different between the old and new 
surveys, and derive seasonal factors for the new survey if the differences are found. We will 
show how the information from these two parallel surveys, disaggregated over a number of 
lower level series, can be used in multi-level modelling to test the differences in the seasonal 
factors between the old and new survey data at an aggregate level for the overlapping time 
periods. Seasonal factors for the time series obtained from the new survey can also be 
obtained. 


2.2 Multi-level and mixed effects models 


Multi-level models can be used to reflect variation in parameters between groups in a 
hierachical structure in a given system (Goldstein, 1995). 


In the case where a new survey and an old survey are being conducted and both surveys are 
measuring the same underlying activity, it is appropriate to use a mixed effects incorporating 
nested random effects. Laird and Ware (1982) describe a general approach to this type of 
model. The mixed effects model allows for fixed (common) effects between the new and old 
surveys and between different groups, and random effects across the new and old surveys and 
also across the different groups. 


Denote an original series at time t by yj; where for the given survey i, the new survey is 
denoted by i= 1 and the old survey by i =0; data is available at a number of group levels 
j= 1,...,n. The original series can be decomposed using a multiplicative relationship 
Vir = Taj X Sige X Lit (1) 
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where Tj; is the trend component, Sj; is the seasonal component, and Jj; is the irregular 
component with a mean of 1.0. For a multiplicative related time series, a seasonal component 
of Sj: = 1.0 is interpreted as that time point being seasonally neutral. Sj; > 1.0 is interpreted as 
that time point being seasonally high, and $j; < 1.0 is interpreted as that time point being 
seasonally low. 


Firstly, assume a log additive model for the time series decomposition. The Appendix gives 
an explicit correction factor for the bias introduced by using the log transformation. The 
results in this paper did not correct for the bias of the log transform. This is not expected to 
impact significantly on the conclusions. 


Secondly, assume the logged trend component can be modelled as a locally linear process 
within the overlapping period. For example 


log(Tijt) = (at ay) + (b+ bt 


where a represents the intercept term for the trend. aj denotes the intercept random effect at 
the survey and group level, b represents the fixed slope term for the trend, b; represents the 
random effect of the slope at group level, aj ~ M(O,2.,) and bj ~ N(O, Xp,). Note that the 
growth rate b; does not depend on the survey. That is, both surveys have the same growth but 
will have different intercepts, aj. This means that the level of the trend are dependent on the 
survey and group, and the growth of the each group are the same for the both surveys. 


For the seasonal component 
log(S ij) = (C+e;) S: 


where s, is a seasonal dummy variable, c represents the common fixed seasonal factor vector, 
c;; denotes the seasonal random effect at the survey and group level, and ¢; ~ N(0, 2-,,). Here, 
c= (C(1),--,Cq) and >);;C”@ =O where p is the number of periods (p =4 for quarterly and 
p = 12 for monthly). Similarly for c,. 


Combining these two steps and representing the trend, seasonal and irregular components in 
terms of a model based approach gives 


log(y ir) = log(Tijr) + log(Sij) + log(ijr) 
=(a+aj)+(b+b)tt+(et+ey) 8+ ei 
SS ——_ 


Mw 
trend seasonal irregular 


(2) 


Due to the multiple levels hierarchical structure, we consider that the data is grouped with 
nested classifications factors ‘group’ and ‘survey’. The two nested grouping factors could 
have a different effect on the observed responses. With this setting, the log additive 
decomposition model (2) can be rewritten as a multiple level mixed random model 


log(y ir) = log(T ir) + log(Siz) + logit) 


=(at bt+e's,) + (aij + bjt + € 481) + ig 
OO ee —_——Y 


(3) 
fixed effect random effect 
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where i= survey indicator (0,1), j= group indicator, aj and cj represent the intercept, and 
seasonal random effects at the survey within group level, b; denotes the random effect of the 
slope at group level, éj;= error term and f=time. 


Under certain normality conditions, the fixed and random coefficients can be estimated by 
fitting the model (3) in the mixed model framework (Pinheiro and Bates, 1999). 


The coefficients of the seasonal dummy variables s; for each level of a factor cannot usually 
be estimated because of dependencies among the coefficients of the overall model. For 
example, the sum of all the seasonal dummy factors, which is a vector of all ones. This 
corresponds to the term used for fitting an intercept. Overparametrization induced by dummy 
variables needs to be removed prior to fitting the model. This is done by replacing the dummy 
variables with a set of linear combinations of the dummy variables. A particular choice of 
linear combinations of the dummy variables for the seasonal factors alters the specific 
individual coefficients in the model, but does not change the overall contribution of the term 
to the fit. Therefore, the coefficients of the seasonal dummy variables of model (3) may not 
be unique. This means that the estimated seasonal coefficients from model (3) may not be 
useful. However, the estimated intercepts and slopes can be used to produced a detrended 
series 


log(y,) = log(y ir) — (4+ dy + bt + bjt) (4) 


The detrended series can be considered as containing a seasonal pattern which is affected by 
the group, survey within group, and irregulars. 


Our objective is to test whether the seasonal factors have been changed from the old survey to 
new survey at the aggregated level. The fixed seasonal factors of the old and new surveys 
with the random seasonal effects at group level and at survey within group in model (5) can 
be used to provide statistical inferences to judge whether the seasonal factors have been 
changed. That is 


log(Vj,) = c,S; + (¢; + Cy)'S; + Ei (5) 
ond 
fixed effect pandom effect 
where ¢; is the fixed seasonal effect for the old and new survey (i= 0, 1) respectively, and 
c; ~ M(O, Xe;) and cj ~ N(O, Xe) are random seasonal effects at group level and at survey 
within group level respectively. 


Section 2.5 describes a practical approach to estimate seasonal factors at an aggregated level. 
We consider the case where the groups j are 15 industries to give state and Australia total 
estimates of the seasonal factors. Alternatively, the groups could have been taken as 8 states 
to give an Australian total estimate of the seasonal factors. 


2.3 Bridging the model and filter based seasonal factors 


The ABS does not currently use model based methods to estimate seasonal factors. The ABS 
uses a filter based approach based on the commonly used seasonal adjustment packages X11 
(Shiskin et. al, 1967) and X12ARIMA (Findley et. al, 1998). For a description of ABS’s 
approach see ABS (2001c). 


Estimation of the parameters in the model based framework described in Section 2.2 can 
enable us to compare the difference between the old and new seasonal factors. We will 
assume for practical purposes that the ratio between the new and old seasonal faactors based 
on the model will be a good approximation to the filters as estimated under X11. 


If the difference is statistically significant, the model based estimates of the seasonal factors 
need to be converted into a filter based framework. We assume that the proportional 
relationship between the seasonal factors for the new and old surveys is consistent between 
the filter and model based frameworks. This can be expressed as 


Filter" __ exp(Model"") 


Filter?!4 ~~ exp(Model?!4) (6) 
where Filter”” are the unknown filter based seasonal factors for the new survey, F ilter°@ are 
the known filter based seasonal factors for the old and can be estimated, exp(Model””) and 
exp(Model°) are the estimated model based seasonal factors for the new and old surveys 
respectively. Equation (6) is used to estimate Filter”’” which can then be applied within the 
ABS framework. 


2.4 Steps involved in modelling seasonal factors 
For a given time series these steps should be followed: 


a. Estimate all the parameters in the full model as described in equation (3). For 
example, the estimation procedure nlme in Splus could be used (Pinheiro 
and Bates, 1999). Alternative estimation procedures could be used. 


b. For practical convenience, we remove the estimate of the intercept and the slope 
(trend) from the original data 


log(y#,) = log(y ir) — (G+ dy + bt +t Bt) 


Here, log(y;;,) contains seasonal patterns and irregulars from which the seasonal 
factors can be estimated by the seasonal dummy coefficients. 


C; Estimate the common seasonal factors ¢ with the seasonal random effects at group 
level at survey within group by using the model (without intercept) 


log(yiz) = CS +(C; + ¢;)'S; + &ijt 
aed ns 
fixed effect pandom effect 
The constrast between seasonal factors ¢; (i= 0,1) with random seasonal effects 
at group and survey within group in model (5), can be used to provide statistical 
inferences to judge whether the seasonal factors have been changed. 


If differences are found to be statistically significant, the estimates for the fixed 
common seasonal factors can be thought of as the seasonal factors for the new survey. 


Equation (5) implies })7.,cjq =0 where c= (ci,...,cq) and p is the number of periods 
(p =4 for quarterly and p = 12 for monthly). However, the model is fitted (estimation 
of c) by a method of maximizing the restricted log-likelihood so this criteria may not 
be automatically met numerically. This means that the estimates for ¢ will need to be 
scaled by an appropriate factor, f. For a multiplicative model this constraint is used to 
ensure that the estimated seasonal factor ¢; satisfy papa € a =p where © =fexp(ci). 


d. Apply the model based seasonal factors to estimate X11 based seasonal factors 
using equation (6). 


3 Real world example 


The Quarterly Business Indicator Survey (QBIS) (ABS, 2001a) produces estimates of private 
wages and salaries on an accruals (accounts) basis. This survey replaced the Survey of 
Employment and Earnings (SEE) (ABS, 2001b), which produced estimates for private and 
public gross earnings on a cash (payroll) basis. SEE has now been replaced by a third survey 
which only collects public gross earnings. The private wages information collected from 
QBIS is used in the estimation of compensation of employees within the Australian system of 
National Accounts. 


To estimate the impact of the change over to the new survey, four parallel quarter estimates 
were produced from March quarter 2001, to December quarter 2001 inclusive. This gave 
original estimates at these time points for both the QBIS and pay period adjusted SEE survey. 
An additional 4 data points for only the SEE data were used from March quarter 2000 to 
December quarter 2000 inclusive to ensure that the model described in (2) is identifiable and 
therefore numerically feasible. The original estimates for each survey were at the state by 
industry level. For example, NSW at Mining, Manufacturing, Electricity Gas and Water 
supply, Construction, Wholesale Trade, Retail Trade, Accommodation Cafes and 
Restaurants, Transport and Storage, Communication Services, Finance and Insurance, 
Property and Business Services, Education, Health and Community Services, Cultural and 
Recreational Services, Personal and Other Services. This industry level information was used 
to estimate seasonal factors at the NSW level. A separate analysis was done for all eight 
states and at the Australian total using industry as the groups. In this example, the number of 
data points available is small, 15 industries with 4 overlapping data points. Maas and Cox 
(2002) show that the small sample sizes have a negligible impact on the estimates of 
multi-level model parameter estimates. 


The Australian total can be derived two different ways. To ensure consistency with the state 
total estimates the Australian total was calculated by aggregating over the industry totals. 
Alternatively, the total could have been derived by aggregating across the state totals. 


The results of this analysis were used in the compilation of the ABS National Accounts for 
March quarter 2002. Seasonal factors were generated for March quarter 2002 to December 
quarter 2002. These seasonal factors are not presented here. 


3.1 Results for Quarterly Business Indicator Survey and Survey of 
Employment and Earnings 


Figures la and 1b show the estimated model based seasonal factors on the exponential scale 
for the new survey (QBIS) and the differences between the estimated model based seasonal 
factors on the exponential scale for the new and old survey (QBIS - SEE) for each state and 
total Australia level. An 80% confidence interval on the differences has also been calculated 
using estimates of the standard errors of the differences obtained from the estimation 
procedure. This confidence level was chosen as it gives a margin of error around 1%. For 
example, a movement in the seasonal factor from 1.00 to 0.99 equates to 1%. In practical 
terms this movement can be quite important. 


All states and the Australian total, apart from Tasmania, had a low seasonal factor for the new 
survey for March quarter 2001. The June and September 2001 quarters seasonal factors for 
the new survey were a mixture of high and low seasonal factors across the different states and 
total. All states and the Australian total, apart from ACT, had a high seasonal factor for the 
new survey for December quarter 2001. 


Queensland and the Northern Territory had the most differences between the seasonal factors 
for the old and new survey. In some cases, the differences were up to 6%. States which did 
not have significant difference between the model based seasonal factors for the old and new 
survey were: Victoria, Tasmania, ACT and the Australian total. 


Figure la: Model based seasonal factors on the exponential scale and difference between the model 
based new and old seasonal factor point estimates for states with the bars denoting an 80% 
confidence interval for March quarter 2001 to December quarter 2001: New South Wales (NSW), 
Victoria (Vic), Queensland (Qld), South Australian (SA) and Western Australia (WA). 
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Figure 1b: Model based seasonal factors on the exponential scale and difference between the model 
based new and old seasonal factor point estimates for states with the bars denoting an 80% 
confidence interval for March quarter 2001 to December quarter 2001: Tasmania (Tas), Northern 
Territory (NT), Australian Capital Territory (ACT), and Total by Industry (Australian Total). 
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Table 1 gives comparisons between seasonal factors for the old and new survey at each state 
and total level after the model based seasonal factors have been converted to the filter based 
seasonal factors. This is essentially the same information as presented in Figures la and 1b 
and similar comments apply. 


Table 2 gives 80% confidence intervals for the final filter based seasonal factors. As the 
seasonal factors for Victoria, Tasmania, ACT and Australian Total are not statistically 
significant between the old and new survey, the seasonal factors known for the old survey 
were used. For NSW, Queensland, South Australia, Western Australia, and Northern 
Territory the filter based seasonal factors estimated for the new survey were used. If the 
confidence intervals contain 1.0, then there is a chance that quarter may be seasonally neutral. 


These results were used in the final decision on which were the appropriate seasonal factors 
to use. As the seasonal factors between the old and new survey were not significantly 
different for the Australian Total, the decision was made to continue to use the old (SEE) 
seasonal factors for the March 2002 quarter. 


1 


Table 1: Comparison of final filter based seasonal factors for the old and new survey for different 
states. * denotes that the estimated seasonal factors were not significantly different between the old 
and new survey (at the 20% confidence level). 


Series Mar 2001 | Jun 2001 | Sep 2001 | Dec 2001 
NSW New 0.984 1.004 0.983 1.029 
Old 0.981 0.994 0.995 1.030 
* Victoria New 0.983 0.999 0.984 1.034 
Old 0.985 0.993 0.992 1.031 
Queensland New 0.924 0.979 1.019 1.081 
Old 0.972 0.992 0.991 1.045 
SA New 0.998 0.985 0.999 1.015 
Old 0.969 0.992 1.008 1.030 
WA New 0.986 1.024 0.962 1.029 
Old 0.979 1.015 0.993 1.013 
* Tasmania New 0.988 1.023 0.967 1.022 
Old 0.974 1.019 0.965 1.042 
NT New 1.047 1.001 0.966 0.987 
Old 1.004 0.995 0.987 1.014 
* ACT New 0.986 1.021 0.967 1.024 
Old 0.962 1.043 0.990 1.005 
* Total x Ind New 0.977 0.999 0.988 1.036 
Old 0.980 0.996 0.993 1.031 


Table 2: Upper and lower confidence intervals (80%) estimated for the final filter based seasonal 
factors. 


series Mar 2001 | Jun 2001 Sep 2001 Dec 2001 
lower 0.972 0.992 0.971 1.016 
NSW 0.984 1.004 0.983 1.029 
upper 0.996 1.017 0.996 1.042 
lower 0.972 0.979 0.979 1.017 
Victoria 0.985 0.993 0.992 1.031 
upper 0.998 1.007 1.005 1.045 
lower 0.906 0.959 0.999 1.060 
Queensland 0.924 0.979 1.019 1.081 
upper 0.943 0.998 1.039 1.103 
lower 0.977 0.964 0.978 0.994 
SA 0.998 0.985 0.999 1.015 
upper 1.020 1.007 1.021 1.037 
lower 0.958 0.996 0.935 1.000 
WA 0.986 1.024 0.962 1.029 
upper 1.014 1.053 0.989 1.058 
lower 0.928 0.952 0.916 0.983 
Tasmania 0.974 1.019 0.965 1.042 
upper 1.023 1.090 1.017 1.105 
lower 1.015 0.970 0.936 0.957 
NT 1.047 1.001 0.966 0.987 
upper 1.080 1.032 0.996 1.017 
lower 0.909 0.977 0.935 0.943 
ACT 0.962 1.043 0.990 1.005 
upper 1.019 1.112 1.048 1.071 
lower 0.967 0.985 0.982 1.019 
Total x Ind 0.980 0.996 0.993 1.031 
upper 0.993 1.007 1.004 1.044 
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4 Conclusions 


Methodology changes will continue to occur to surveys conducted by government statistical 
agencies. When this happens, new surveys which include the methodological changes may 
replace the previously used surveys. In the case where lower level group data are available, 
the approach of using a multi-level model with mixed effects as described in this paper 
provides an approach to estimating seasonal factors for short span time series at an aggregate 
level. Once seasonal factors have been estimated, seasonally adjusted and trend estimates can 
be derived for short span time series. This methodology can also be used when survey data is 
replaced by taxation or other administrative data. 


Topics for future work will include: 1. Correction of the log bias transformation using the 
approach outlined in the Appendix. 2. The splicing of the new and old survey into one 
continuous time series. This can be achieved by obtaining an estimate from the multi-level 
model with mixed effects of the magnitude of the level shift between the two surveys. A 
seasonal break correction factor can be estimated once the seasonal factors for the new survey 
are known. This information can be used to give a trend and seasonal break into the spliced 
series to produce quality seasonally adjusted and trend estimates. 3. Improved estimates of the 
seasonal factors may be obtained by the use of appropriate covariance structures to handle 
survey sampling error in the mixed model estimation. 
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A Appendix 


See Franses et. al (1997) for an alternative approach to deriving a correction factor for the log 
transform of an ARIMA time series forecast. 


Assume a multiplicative decomposition model for an original value Y; at time f. 
Y,=T;xS;xfi 

This model is often converted to a log additive model 
VWr=Tr+S¢+h; 


where y; = log(Y;), tT; = log(T:), s: = log(S;) and i; = log(/;). Various statistical techniques are 
easier to apply to the additive model rather than the multiplicative model. 


The conversion method for estimation of T; is to use 7; =exp(t,) . This conversion gives 
biased estimators for 7;. The more generic problem can be described as follows. 


Suppose X is a random variable with a lognormal distribution Lognormal(E(X), Var(X)). 
Therefore Y = log(X) is a random variable with normal distribution N(E(Y), Var(Y)). 


This exercise proves that 
E(X) = exp(E(Y) + 0.5Var(Y)) 


Var(X) = {exp(Var(Y)) — 1} exp(2E(Y) + Var(Y)) 


This result is important to correct bias when transforming from a logged additive model to a 
multiplicative model. An alternative general derivation can be done using Taylor series 
expansion. 


~(y-a)? = 
1 too y a 
Let a = E(Y) and o? = Var(Y). Then E(X) = eve 20 dy and let z=-Z— so 
J2m02 ° ~~ 
1 He zota =e 
E(X) = ae Jee e 2 dy 
1 ae Jd (ayes pS) 
= e 2 dz 
4 270 
1 ae [ee =F (eo)? 
= e 2 e 2 dz 
20 ics 
oc 
=e? 
= exp(E() + 5 Var(¥)) 
Consider 
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1 (ya)? 


+00 oe 
Tigae 1wle? Bane" dy 
: 1 


f 2 
== ie a ee mn i 2erE(X)e" 7 dz + ; We E(X)2e~2 dz 
i V2n 


Var(X) = 


Expanding each term gives 


Var(X) = e*7°) — 2E(X)? + E(X)? 


2(ato2) _ e2ato 


=e 
= (e* a 1e24*7" 


= {exp(Var(Y)) — 1} exp(2E(Y) + Var(Y)) 


ie 


FOR MORE INFORMATION... 


INTERNET 


LIBRARY 


CPI INFOLINE 


DIAL-A-STATISTIC 


www.abs.gov.au the ABS web site is the best place to 
start for access to summary data from our latest 
publications, information about the ABS, advice about 
upcoming releases, our catalogue, and Australia Now-a 
statistical profile. 


A range of ABS publications is available from public and 
tertiary libraries Australia-wide. Contact your nearest 
library to determine whether it has the ABS statistics 
you require, or visit our web site for a list of libraries. 


For current and historical Consumer Price Index data, 
call 1902 981 074 (call cost 77c per minute). 


For the latest figures for National Accounts, Balance of 
Payments, Labour Force, Average Weekly Earnings, 
Estimated Resident Population and the Consumer Price 
Index call 1900 986 400 (call cost 77c per minute). 


INFORMATION SERVICE 


PHONE 


EMAIL 


FAX 


POST 


WHY NOT SUBSCRIBE? 


PHONE 


EMAIL 


FAX 


POST 


Data which have been published and can be provided 
within five minutes are free of charge. Our information 
consultants can also help you to access the full range of 
ABS information-ABS user-pays services can be tailored to 
your needs, time frame and budget. Publications may be 
purchased. Specialists are on hand to help you with 
analytical or methodological advice. 


1300 135 070 
client.services@abs.gov.au 
1300 135 211 


Client Services, ABS, GPO Box 796, Sydney 2001 


ABS subscription services provide regular, convenient and 
prompt deliveries of ABS publications and products as they 
are released. Email delivery of monthly and quarterly 
publications is available. 


1300 366 323 
subscriptions@abs.gov.au 


03 9615 7848 


Subscription Services, ABS, GPO Box 2796Y, Melbourne 3001 
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